AD"A112 984 NAVAL UNDERWATER SYSTEMS CENTER NEW LONDON 
FITTING A POLYNOMIAL: TO OATA IN THE PRESENCE OF NOISE. (U) 
FEB B2 NL OWSLEYs UF LAWs A A LESICK 

UNCLASSIFIED NUSC-TR-6569 


Voor | 
fron 


AL 


is i 


tet - 


WLZS (Ls 7 


NUSC Technical Report 6660 
@ February 1962 


Fitting a Polynomial to Data 
In the Presence of Noise 


Norman L. Owsley 

' John F. Law 
Andrew A. Lesick 
Geraid R. Swope 
Submarine Sonar Department 


AD A112984 


; 

as F 

Yan, 4 RASh 

Noprante 
Svs 


_ Naval Underwater Systems Center 
>—-Newport, Rhode Island / New London, Connecticut 


Cre 
© 
q> 
as 
—_ 
fade 


On 


© 
EY « oe 
Ss’ 
al 


TR 6569 


PREFACE ° 
This work was sponsored by NAVSEA 63R, Daniel Porter, 
Program Manager, and was conducted within NUSC Code 32) . 


under J.0. A6S400; Norman Owsley was the Principal In- 
vestigator for the NUSC project in Multifunction Adaptive 
Processing. 


The Technical Reviewer for this report was Gary 
Griffin, Code 3352. 


REVIEWED AND APPROVED: 6 Februar) 1982 


The authors of this report are located at the New London 
Laboratory, Naval Underwater Systems Center, 
New London, Connecticut 06320. 


FITTING A POLYNOMIAL TO DATA IN THE PRESENCE OF 


Norman L. Owsley Gerald &. Swope 
John F. Law 
Andrew A. Lesich 


Naval Underwater Systems Center 
New Londen Laboratory 


Te COEGLLING GOONS NaS OA COSTEED 
Naval Sea Systems Command, (SEA 038) © February 1982 


1 CRORES CEOITEREM way chen Degas 


Approved for public release; distribution unlimited. 


9? SOMERS SST wat te ewer med @ Get Bf dee fan Oapere 


oS A89 CORED Cesmmes on reper ab ¢ esnmeny ent idneefy Gp Girud ensathete 


Signe) processing 
Polynomial models 


Polynomial aodels arise in mumerous applications in signal processing 
dealing with the estimation of continuous functions of either space or time 
The requirement to interpolate between discrete noisy dats points is of 
particular interest. In this report, the general-order polynomial tiwe- 
varying coefficient-estimation problem is formulated and a structure is 
indicated for iaplementation of the coefficient-estimation process. Both 
the maximum likelihood (ML) and maximum a posteriori (MAP) estimation 
coefficient estisators are derived and the corresponding analyses of (over 
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variance are obtained. The cases of measurement data consisting of samples 
of either the polynomial directly or the polynomial siope ia the presence 
of additive poise are considered. Finally, expressions for the sensitivity 
to wumcompensated measurement bias of the estimator standard deviations are 
obtained. 
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FITTING A POLYROMEAL TO GATA IN THE PRESEACE OF NOISE 
.6 INTRODUCTION 


Pelynomials provide commeniy uted sadels for functions representing pro- 
€etses Of laterest te space: and Cime- series anai;sis. Specifically, tne 
polynomial provides 4 convenient aetiod far dala laterpolatian and smothiag. 
Of particulas iaterest here 16 the S-IA order polynomial, which is Linear 328 
ste coefficients The gracral problem aliews far time wering cacffi cients 
foe which prices statistical heovledge of tee palsmaniel cneffiacients a. rendor 
PFOKeevee 32 sealable either Thgeegh pycical gadsliang OF actual measurements. 


Foe Uke Time ie@eeri ant pelymemial, too tppes af ost iaatare efe considered. 
Feeet, Che Qacigam tikhelinoad (16) est laser, wich aseumes the cachFicionts 
to be renfemden (deteTRiaistic) tet whem, 16 cpasidered. Paen, Ube manrmun 
@ pweteriogs (WO?) ectianter, ehic® accames the coefficients ta be random vari: 
miler. be emerdsted. The WP eetinsion fequifes priet bnaelodge ef Che moan 
vobuse end covestane @utgis fer the fandan poiynemial coefficients. Beth Ube 
We aed OY cclimater: escemy Ue polynenial covfficionts (0 br constant aver 
the tompweel iatereal fer hich Guarwrenetts sre eveiiatie tag Cime: veri abies 
SeelT se: cemte, @ stovestive (hola) Fiites ewstiietian of One UP ceethaczent 
oct i mates +s prevented 


te pteutice. 60 10 Freqemetiy Ute case Phat Uw dele fe chick Une pods 
Reset Gedet te te te Fitted qatoicts eithes of samples of the wndet i ying 
Plocees i0 & Caslevia® (¢.9) Comtdiaale syste ples © tPEeEteRNH Hej HE OF 
samples of the slope (detiveticve) of (te wudetiving press ple: e verre: 
spending disturbance. fer both Crepes of Fit date, Uke tearetemen aeine i+ 
anwumed te be tote Geum, ahuertelated. ahd Gamssiam o)1% bom veri anus. 


teamptes of beth Cartesian (amplitede) and stope:-samied dete sivut i+ 
position treukiag aad pPrece trwehiag fe the position -ext imation probion. 
amp litube campling eusld cortesqued te heving Fil dete im fartesion woordi nets 
fwem. +6... R@ity Mrecetende of the ¢-ewordinete of 9 Fuutinn of (40 #110. 
ordinate. Slope campling cowld correcgend te Wweimg wise corrupted engis 
meacutement« ef the tangent to the deriving femution telstive fo © wntds - 
nate svetem that sitewe 2 well -amgte limestiretien senumptian = «The omei)- 
mghe accumption abies the Fumetion detivetive ond faution tengem engie 1» 
be equated. 3 peeific erample tote Bight be the recarstfutia of 8 Kent in- 
wows epetial track spyeeeianted by @ polymenisl. giver dots voneicting of 
ertRhet compess Reading geacotenemes (elope) of Ietifiude ‘longitude mMeenprement s 
(amptitude) ot disetete peiats along the track Fit tengect te the those. 
treeking erampte. splitude sampling ewald corvecqend to heerng discrete 1390 
samples of the eeice -corrupted puse pfeces: ad chepe aati ting nei J prahias 
spend te having samples +f the (ide detivetive of the these preves:. i. 
instant ameoes Freqeemey. Free chic to recent rect the cond inns shies Fane - 
tien. 


After iat redecing the basic polowenieal-fit preoble® im nye. the nert 
section develops the %& estiantes. fhe “ estiaeter veriamwe is stained ond 


the question of biased avasurements 15 esamined. The following section pre- 
sents a similar development of the WP estimator. test, somes mmerical 
vesults ave presented and some ust ful expressions are obtained for the second 
order polynomial fit. Finally, @ cocursive estiastion scheme for tracking 
time-varying polynomial ceefficieets is formated. 
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zz tm,h) = disg) © vp (m,b) (slope) (8) 
for w+ 1,2,...,% position samples and bh = },2,...,k time samples are avaiable 
when the S-th ovder pelynamal is to be fit to anplitude- and siape- sampled 
data, respectively. The © sample posts, 4, @ + 3.2..--.%, ere assumed to be 
haouwn. The iadea h 1% 2 discrete tiee-sample mamber indes for which 2 mpasure- 
ment ialerval consistiag Of 6 samples 15 arcilanle. 
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with vespect te variations ia @ if this saximization is performed, the corre- 
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where Oy is the M-by-M identity matrix. Thus, as the number of measurements 
increases to the bimit, there results from equation (28a) 


Rap = @. (29) 
tim Keo 


In the random-paramcter case, the total information matrix is obtained by 
appendiag the inverse matria My*, which represents prior knowledge, to the 


information matria for the nonrandom NL parameter estimator. Accordingly,! 
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»~San- eo. (30) 
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therefore, the lower bound on Che variance of an unbiased NSE estimator 
be saticfied by the WAP estiaator of the a-th polynomial coefficient, a(n). 
Ris Buoutd be given By 
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$.0 ThE SECUD-ORDER POLYNOMIAL 


ta this section. the important second-order polynomial sode! 
y(e) + a(hye = a(2jat , (Oe x < Lb) (33) 


bt @eamined i@ detail vith tecpect to the estimation of the coefficients a(1) 
ted atc). The estimeter error variance and corresponding lower variance bound 
ate etamined with tespect to W, the aumber of spatial-sample points x,,x5,.... 
ty available and t, the sumber of tiae-sample points. 


the © positional sample points are assumed to be uniformly spaced over 
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tos shape measurement data. The midpoint-distortion estimator is a linear 
4m eration of the ML polynomial coefficient estimators, which individually 
Nave Reem shown to reach the so-called Cramer Rao (CR) lower variance bound. 
Mee, the distortion ML estimator also performs at the CR lower bound on vari- 
moe 


The WAP estimator, G@yap, allows the covariance matrix, Ryap, to be 
sey tected explicitly in terms of the measurement variance o? and the param- 
shave Wand &. In particular, the MAP midpoint-distortion estimator, using 
tluge Qeeverements, is given by 


2 ’ rpL’ _ kpr]2 2 2M - 1 
rte), aes 1 1 a2 3 ML 7 SS 


(38) 


wheve the coefficient covariance matrix R, is defined as 
1 0 
R, ‘ P{? | . (39) 


Re eertesponding variance using amplitude measurements is more complicated 
wed. thetefore, provides little additional insight into critical parameter 
qependence. It is, therefore, not included here.. 


fee sensitivity of the ML estimator to measurement bias error for the 
ceqeteb-etdet system is of particular interest. From equation (24), the addi- 
tiered BE contribution for the midpoint distortion due to an uncompensated 


quesurenent bias vector, b, is 
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ot (3)-[[e() - $ eco] (HTH) “Hef 0 
The first type of bias considered is termed “single-point bias," wherein 
b= (0---0b0---o], (41) 

such that only the m-th element in the bias vector is nonzero with bias b. 


For the slope-measurement case, the resulting bias variance in the distortion 
estimator is 


% (ahs - (eee . (42) 


The corresponding sensitivity of the standard deviation to the bias is, there- 
fore, 


ety (2), 
ML _ 135L units of length 
ab e Exc + 1) [M - 2m + 11] degree , (43) 


An examination of equation (43) indicates that the least degrading region 
for single-point bias errors to occur is near the center of the measurement 
aperture. In fact, for the point m = (M+ 1)/2, the error is precisely zero. 
On the other hand, single-point bias errors near the measurement aperture 
extremities are most degrading. Clearly, having a large number of sensors 
serves to reduce the single-point bias errors by averaging. 


The second type of bias error is referred to as "uniform bias," wherein 
bo -=btli---a), (44) 


that is, all heading-angle measurements are equally biased by an amount b. In 
this instance, it is straightforward to show that the bias MSE from equation 


(40) is 
5 (5) = 0 (45) 


for the slope-measurement process. This result shows that if equal bias exists 
in the slope measurement at all M measurement points, the net effect in terms 
of estimating the quadratic component of polynomial shape distortion is zero. 
Obviously, an error would occur in estimating the linear (rotational) compo- 
nent of the polynomial shape. This rotational error is linearly related to 

the bias angle b. Finally, if all M of the slope-measurement sensors have a 
random error, ba; m = 1,2,...,M, which are zero mean, uncorrelated, and iden- 
tically distributed with variance o2, then, by superposition, equation (42) 
yields 


2 
2 (L) 2 3b y2Mal 
: (3), iow hei: (46) 
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Notice the similarity between the unbiased ML estimator variance of equa- 
tion (37) and the result in equation (46). However, the bias error is not 
reducible by time averaging because it is a static bias. 


6.0 NUMERICAL RESULTS 


Simple variance expressions for the polynomial midpoint-distortion esti- 
mators are difficult to obtain for polynomials of order N > 3. Accordingly, 
in this section, some numerical results are presented that illustrate the 
dependence of the midpoint-distortion estimator standard deviation on the num- 
ber of equally spaced measurement (sensor) points M, which are uniformly dis- 
tributed at points x, = (m - 1)L/(M - 1), m= 1,2,...,M, and the order of the 
polynomial N. For the MAP estimator, the prior knowledge, which consists of 
the polynomial-coefficient covariance matrix, is given by 


3.637 x 1075 0 i) 
R, = }0 4.4 x 1033 0 . (47) 
0 0 2.0 x 10718 


The estimator standard deviation versus number of measurement points, M, 
for both Cartesian (amplitude-) and slope-measurement data fitting are pre- 
sented in figures 1 and 2, respectively. A single time sample, K, is assumed. 
The measurement noise variances assumed are 


o2 = 1.0 m 
for Cartesian measurements and 
of = 0.228 x 10-% (radians)? 
for slope measurements. 


A general observation fom these results is that the order of the fit 
polynomial should be as low as possible while remaining consistent with the 
underlying physical process being modeled. The ML process degrades less rap- 
idly with increasing polynomial order than the MAP process, at least for the 
covariance matrix given in equation (47). These qualitative statements are 
quantified by the results presented in figure 3 for Cartesian (amplitude) 
measurement data and figure 4 for slope measurements. For both estimators, 
as the number of measurement points, M, increases, the variance decreases. 
Both estimates, in fact, are asymptotically equivalent as either the number of 
measurement points, M, or the number of time samples, K, becomes infinite. 
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